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DETAILED ACTION 

Priority 

1 . Receipt is acknowledged of papers submitted under 35 U.S.C. 1 1 9(a)-(d), which 
papers have been placed of record in the file. 

Response to Amendment 

2. Receipt of Applicant's Amendment, filed on 12/26/2007, is acknowledged. The 
amendment includes the addition of claims 14-18, the amending of claims 1, 3-12, and 
the cancellation of claim 2. 

Claim Rejections ■ 35 USC §112 

3. The rejections raised in the office action mailed on 08/22/2007 have been 
overcome by applicant's amendments received on 12/26/2007. 

Claim Objections 

4. Claim 1 is objected to because of the following infomnalities: The phrase "a 
display output portion for outputting said predetermined kind of should be changed to 
a display output portion for outputting said predetermined kind of character". 
Appropriate correction is required. 

Claims 3-5, and 9-14 are objected to for incorporating the deficiencies of 
independent claim 1 . 

5. The numbering of claims is not in accordance with 37 CFR 1 .126 which requires 
the original numbering of the claims to be preserved throughout the prosecution. When 
claims are canceled, the remaining claims must not be renumbered. When new claims 
are presented, they must be numbered consecutively beginning with the number next 
following the highest numbered claims previously presented (whether entered or not). 

Misnumbered claim 18 has been renumbered 17. 

Claim Rejections • 35 USC § 103 

6. The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set 
forth in section 1 02 of this title, if the differences between the subject matter sought to be patented and 
the prior art are such that the subject matter as a whole would have been obvious at the time the 
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invention was made to a person leaving ordinary sM in the art to which said subject matter pertains. 
Patentability shall not be negatived by the manner in which the invention was made. 

7. Claims 1-2, 6-8, and 13 are rejected under 35 U.S.C. 103(a) as being 
unpatentable over Hyon (U.S. PGPUB 2002/0077135) in view of Baker (U.S. Patent 
6,546,417). 

8. Regarding claim 1 , Hyon teaches a display device comprising: 

A) a first storage portion for storing beforehand a character code for specifying each of 
said predetermined kind of character (Paragraphs 23, and 41-42, Figure 4); 

B) a second storage portion for storing an image code for specifying said reoistered 
image and non-standardized image data corresponding to said image code in a 
correlated manner, said registered image being generated by a user (Paragraphs 23, 
25, and 44, Figure 2); 

C) a display output portion for outputting said predetermined kind of and said registered 
image (Paragraph 21, Figure 2); and 

D) a display control portion for causing said display output portion to output 
corresponding said predetermined kind of character and said registered image both 
belonging to an identical sentence based on display data containing a series of said 
character code, text attribute data, and said image code (Paragraphs 21 and 41-42); 
and 

F) so that said registered image is sandwiched between two parts of said text of said 
predetermined kind of character in a line of said identical sentence (Paragraphs 21 , and 
41-42, Figure 4) 

The examiner notes that Hyon teaches "a first storage portion for storing 
beforehand a character code for specifying each of said predetermined kind of 
character" as "A storage 18 is comprised of a ROM (Read Only Memory) and a RAM 
(Random Access Memory) for storing programs and data, and a voice memory. The 
storage 18 stores an operation program for inputting emoticons and a plurality of 
emoticons in the form of a bit map according to the embodiment of the present 
invention. The plurality of emoticons are stored by groups in the storage 18 to facilitate 
selection of emoticons" (Paragraph 23) and "the user can input a text including typical 
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characters, special characters, or emoticons within the range of a transmittable SMS 
message, by changing input modes" (Paragraph 41). The examiner further notes that 
Hyon teaches "a second storage portion for storing an image code for specifying 
said registered image and non-standardized image data corresponding to said 
image code in a correlated manner, said registered image being generated by a 
user" as "A storage 18 is comprised of a ROM (Read Only Memory) and a RAM 
(Random Access Memory) for storing programs and data, and a voice memory. The 
storage 18 stores an operation program for inputting emoticons and a plurality of 
emoticons in the form of a bit map according to the embodiment of the present 
invention. The plurality of emoticons are stored by groups in the storage 18 to facilitate 
selection of emoticons" (Paragraph 23), "storage 18 stores oriental or occidental 
emoticons according to the cultural area of a user" (Paragraph 25), and "A plurality of 
emoticons are pre-stored in a mobile terminal so that a user easily select an intended 
emoticon in the present invention. In another embodiment, the user can add 
hieroglyphics to basic emoticons stored by a manufacturer. The hieroglyphics can be 
stored in three ways: the user directly stores them, receives them from a base station 
and the stores them, or downloads them from the Internet. The user can change and 
edit the emoticons stored in the mobile terminal" (Paragraph 44). The examiner further 
notes that it is clear that the emoticons which are edited, changed, and user-generated 
must be stored in the RAM of storage 18 since items stored in RAM can be written to 
whereas items stored in ROM cannot be written (i.e. are Read-Only). The examiner 
further notes that IHyon teaches "a display output portion for outputting said 
predetermined kind of and said registered image" as "a display 16 outputs display 
data and text messages generated in the mobile terminal. An LCD (Liquid Crystal 
Display) can be used as the display 16" (Paragraph 21). The examiner further notes 
that Hyon teaches "a display control portion for causing said display output 
portion to output corresponding said predetermined l<ind of character and said 
registered image both belonging to an identical sentence based on display data 
containing a series of said character code, text attribute data, and said image 
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code" as "a display 16 outputs display data and text messages generated in the mobile 
terminal. An LCD (Liquid Crystal Display) can be used as the display 16" (Paragraph 
21), "If the user selects "smile" in the display 6 by manipulating a left/right directional 
key, emoticons that belong to the group "smile" are displayed in a display 7. When the 
user chooses one of the "smile" emoticons " . " In the display 7, the selected emoticon is 
stored as part of the short message as shown in a display 8. Then, the user can input a 
text including typical characters, special characters, or emoticons within the range of a 
transmittable SMS message, by changing input modes" (Paragraph 41), and "After an 
intended text is completed, the user instructs the mobile terminal to transmit the SMS 
message including the emoticon. . .the mobile terminal transmits the stored message" 
(Paragraph 42). The examiner further notes that it is common knowledge that when text 
messages are received via a device, the entire message is displayed at once. The 
examiner further notes that Hyon teaches " so that said registered image is 
sandwiched between two parts of said text of said predetermined kind of 
character in a line of said identical sentence " as "a display 16 outputs display data 
and text messages generated in the mobile terminal. An LCD (Liquid Crystal Display) 
can be used as the display 16" (Paragraph 21), "If the user selects "smile" in the display 
6 by manipulating a left/right directional key, emoticons that belong to the group "smile" 
are displayed in a display 7. When the user chooses one of the "smile" emoticons " . " in 
the display 7, the selected emoticon Is stored as part of the short message as shown in 
a display 8. Then, the user can input a text including typical characters, special 
characters, or emoticons within the range of a transmittable SMS message, by changing 
input modes" (Paragraph 41), and "After an intended text is completed, the user 
instructs the mobile temriinal to transmit the SMS message including the emoticon... the 
mobile terminal transmits the stored message" (Paragraph 42). The examiner further 
notes that display 8 in Figure 4 depicts an emoticon in between text. 

Hyon does not explicitly teach: 
E) said display control portion having image transforming means for transforming said 
reoistered image to be displayed according to said text attribute data; 
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G) wherein said text attribute data contains size attribute data indicating a character 
size of said text : and 

H) said image transformino means that scales up/down said registered image in 
accordance with said attribute data . 

Baker, however, teaches "said display control portion having image 
transforming means for transforming said registered image to be displayed 
according to said text attribute data" as "in order to accommodate the use of 
different size fonts in the mailbox display, means for scaling the size of the icon 
graphics are also provided. ..at least one image for each icon is stored, the icon most 
closely matching the point size of the font is chosen and then scaled as needed to 
better match the font point size" (Column 8, lines 26-40), " wherein said text attribute 
data contains size attribute data indicating a character size of said text " as "in 
order to accommodate the use of different size fonts in the mailbox display, means for 
scaling the size of the icon graphics are also provided. ..at least one image for each Icon 
is stored, the icon most closely matching the point size of the font is chosen and then 
scaled as needed to better match the font point size" (Column 8, lines 26-40), and " said 
image transforming means that scales up/down said registered image in 
accordance with said attribute data " as "in order to accommodate the use of different 
size fonts in the mailbox display, means for scaling the size of the icon graphics are also 
provided... at least one image for each icon is stored, the icon most closely matching the 
point size of the font is chosen and then scaled as needed to better match the font point 
size" (Column 8, lines 26-40). 

It would have been obvious to one of ordinary skill in the art at the time the 
invention was made to combine the teachings of the cited references because teaching 
Baker's would have allowed l-lyon's to provide a method for allowing for scalable icons 
to accompany texts with specified and varied fonts in order to easily associate an icon 
to a particular sentence, as noted by Baker (Column 5, lines 40-55). 

Regarding claim 6, Hyon teaches a method comprising: 
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A) storing an image code for specifying said registered image and registered image 
data corresponding to said image code (Paragraphs 23, 25, and 44, Figure 2); 

B) said registered image being generated by a user and stored in a storage portion 
different from a storage portion of storing the predetermined kind of character 
(Paragraphs 23 and 44); 

D) displaying said predetermined kind of character and said registered image 
simultaneously based on said transformed registered image (Paragraphs 21 and 41- 

42); 

E) so that said registered image is sandwiched between two parts of said text of said 
predetermined kind of character in a line of said identical sentence (Paragraphs 21 , 41- 
42, Figure 4). 

The examiner notes that Hyon teaches "storing an image code for specifying 
said registered image and registered image data corresponding to said image 
code" as "A storage 18 is comprised of a ROM (Read Only Memory) and a RAM 
(Random Access Memory) for storing programs and data, and a voice memory. The 
storage 18 stores an operation program for inputting emoticons and a plurality of 
emoticons in the form of a bit map according to the embodiment of the present 
invention. The plurality of emoticons are stored by groups in the storage 18 to facilitate 
selection of emoticons" (Paragraph 23), "storage 18 stores oriental or occidental 
emoticons according to the cultural area of a user" (Paragraph 25), and "A plurality of 
emoticons are pre-stored in a mobile tenninal so that a user easily select an intended 
emoticon in the present invention. In another embodiment, the user can add . 
hieroglyphics to basic emoticons stored by a manufacturer. The hieroglyphics can be 
stored in three ways: the user directly stores them, receives them from a base station 
and the stores them, or downloads them from the Internet. The user can change and 
edit the emoticons stored in the mobile terminal" (Paragraph 44). The examiner further 
notes that l-lyon teaches "said registered image being generated by a user and 
stored in a storage portion different from a storage portion of storing tlie 
predetermined kind of character" as "A storage 18 is comprised of a ROM (Read 
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Only Memory) and a RAM (Random Access Memory) for storing programs and data, 
and a voice memory. The storage 18 stores an operation program for inputting 
emoticons and a plurality of emoticons in the form of a bit map according to the 
embodiment of the present invention. The plurality of emoticons are stored by groups in 
the storage 18 to facilitate selection of emoticons" (Paragraph 23) and "In another 
embodiment, the user can add hieroglyphics to basic emoticons stored by a 
manufacturer. The hieroglyphics can be stored in three ways: the user directly stores 
them, receives them from a base station, and the stores them, or downloads them from 
the Internet" (Paragraph 44). The examiner further notes that it is clear that the 
emoticons which are edited, changed, and user-generated must be stored in the RAM 
of storage 18 since items stored In RAM can be written to whereas Items stored in ROM 
cannot be written (i.e. are Read-Only). The examiner further notes that Items which are 
clearly not edited/changed/manipulated (i.e. text characters) would be stored In ROM of 
storage 18. Moreover, the examiner further wishes to state that It is well known that text 
characters from a particular font are stored in ROM arid not RAM (see cited reference of 
Hersum (see column 4, lines 55-67 for reference). The examiner further notes that 
Hyon teaches "displaying said predetermined kind of character and said 
registered image simultaneously based on said transformed registered image" as 
"a display 16 outputs display data and text messages generated in the mobile terminal. 
An LCD (Liquid Crystal Display) can be used as the display 16" (Paragraph 21), "If the 
user selects "smile" In the display 6 by manipulating a left/right directional key, 
emoticons that belong to the group "smile" are displayed in a display 7. When the user 
chooses one of the "smile" emoticons " . " in the display 7, the selected emoticon is 
stored as part of the short message as shown in a display 8. Then, the user can Input a 
text including typical characters, special characters, or emoticons within the range of a 
transmlttable SMS message, by changing Input modes" (Paragraph 41), and "After an 
intended text Is completed, the user instructs the mobile tennlnal to transmit the SMS 
message including the emoticon... the mobile terminal transmits the stored message" 
(Paragraph 42). The examiner further notes that it is common knowledge that when text 
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messages are received via a device, the entire message is displayed at once. Tlie 
examiner further notes that Hyon teaches " so that said registered image is 
sandwiched between two parts of said text of said predetermined kind of 
character in a line of said identical sentence " as "a display 16 outputs display data 
and text messages generated in the mobile terminal. An LCD (Liquid Crystal Display) 
can be used as the display 16" (Paragraph 21), "If the user selects "smile" in the display 
6 by manipulating a left/right directional key, emoticons that belong to the group "smile" 
are displayed in a display 7. When the user chooses one of the "smile" emoticons " . " in 
the display 7, the selected emoticon is stored as part of the short message as shown in 
a display 8. Then, the user can input a text including typical characters, special 
characters, or emoticons within the range of a transmittable SMS message, by changing 
input modes" (Paragraph 41), and "After an intended text is completed, the user 
instructs the mobile temninal to transmit the SMS message including the emoticon... the 
mobile tenninal transmits the stored message" (Paragraph 42). The examiner further 
notes that display 8 in Figure 4 depicts an emoticon in between text. 

Hyon does not explicitly teach: 
C) with respect to display data containing a series of a character code, text attribute 
data, and said image code, transforming said registered image to be displayed 
according to said text attribute data; 

F) wherein said text attribute data contains size attribute data indicating a character 
size of said text : and 

G) said image transforming means that scales up/down said registered image in 
accordance with said attribute data . 

Baker, however, teaches "with respect to display data containing a series of 
a character code, text attribute data, and said image code, transforming said 
registered image to be displayed according to said text attribute data" as "in order 
to accommodate the use of different size fonts in the mailbox display, means for scaling 
the size of the icon graphics are also provided... at least one image for each icon is 
stored, the icon most closely matching the point size of the font is chosen and then 
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scaled as needed to better match the font point size" (Column 8, lines 26-40), " wherein 
said text attribute data contains size attribute data Indicating a character size of 
said text " as "in order to accommodate the use of different size fonts in the mailbox 
display, means for scaling the size of the icon graphics are also provided... at least one 
image for each icon is stored, the icon most closely matching the point size of the font is 
chosen and then scaled as needed to better match the font point size" (Column 8, lines 
26-40), and " said image transforming means that scales up/down said registered 
image in accordance with said attribute data " as "in order to accommodate the use 
of different size fonts in the mailbox display, means for scaling the size of the icon 
graphics are also provided... at least one image for each icon is stored, the icon most 
closely matching the point size of the font is chosen and then scaled as needed to 
better match the font point size" (Column 8, lines 26-40). 

It would have been obvious to one of ordinary skill in the art at the time the 
invention was made to combine the teachings of the cited references because teaching 
Baker's would have allowed Hyon's to provide a method for allowing for scalable icons 
to accompany texts with specified and varied fonts in order to easily associate an icon 
to a particular sentence, as noted by Baker (Column 5, lines 40-55). 

Regarding claim 7, Hyon teaches a viewer program comprising: 

A) storing an image code for specifying said reoistered image and registered image 
data corresponding to said image code (Paragraphs 23, 25, and 44, Figure 2); 

B) said registered image being generated by a user and stored in a storage portion 
different from a storage portion of storing the predetermined kind of character 
(Paragraphs 23 and 44); 

D) displaying said oredetennined kind of character and said registered image 
simultaneously based on said transformed registered image (Paragraphs 21 and 41- 
42); 
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E) so that said registered image is sandwiched between two parts of said text of said 
predetermined l^lnd of character in a line of said identical sentence (Paragraphs 21 , 41- 
42, Figure 4). 

The examiner notes that Hyon teaches "storing an image code for specifying said 
registered image and registered image data corresponding to said image code" 
as "A storage 18 is comprised of a ROM (Read Only Memory) and a RAM (Random 
Access Memory) for storing programs and data, and a voice memory, The storage 18 
stores an operation program for inputting emoticons and a plurality of emoticons in the 
form of a bit map according to the embodiment of the present invention. The plurality of 
emoticons are stored by groups in the storage 18 to facilitate selection of emoticons" 
(Paragraph 23), "storage 18 stores oriental or occidental emoticons according to the 
cultural area of a user" (Paragraph 25), and "A plurality of emoticons are pre-stored in a 
mobile temninal so that a user easily select an intended emoticon in the present 
invention. In another embodiment, the user can add hieroglyphics to basic emoticons 
stored by a manufacturer. The hieroglyphics can be stored in three ways: the user 
directly stores them, receives them from a base station and the stores them, or 
downloads them from the Internet. The user can change and edit the emoticons stored 
in the mobile terminal" (Paragraph 44). The examiner further notes that Hyon teaches 
"said registered image being generated by a user and stored in a storage portion 
different from a storage portion of storing the predetermined kind of character" 
as "A storage 18 is comprised of a ROM (Read Only Memory) and a RAM (Random 
Access Memory) for storing programs and data, and a voice memory. The storage 18 
stores an operation program for inputting emoticons and a plurality of emoticons in the 
form of a bit map according to the embodiment of the present invention. The plurality of 
emoticons are stored by groups in the storage 18 to facilitate selection of emoticons" 
(Paragraph 23) and "In another embodiment, the user can add hieroglyphics to basic 
emoticons stored by a manufacturer. The hieroglyphics can be stored in three ways: 
the user directly stores them, receives them from a base station, and the stores them, or 
downloads them from the Internet" (Paragraph 44). The examiner further notes that it is 
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clear that the emoticons which are edited, changed, and user-generated must be stored 
in the RAM of storage 18 since items stored in RAM can be written to whereas items 
stored in ROM cannot be written (i.e. are Read-Only). The examiner further notes that 
items which are clearly not edited/changed/manipulated (i.e. text characters) would be 
stored in ROM of storage 1 8. Moreover, the examiner further wishes to state that it is 
well known that text characters from a particular font are stored in ROM and not RAM 
(see cited reference of Hersum (see column 4, lines 55-67 for reference). The 
examiner further notes that Hyon teaches "displaying said predetermined kind of 
character and said registered Image simultaneously based on said transformed 
registered image" as "a display 16 outputs display data and text messages generated 
in the mobile terminal. An LCD (Liquid Crystal Display) can be used as the display 16" 
(Paragraph 21), "If the user selects "smile" in the display 6 by manipulating a left/right 
directional key, emoticons that belong to the group "smile" are displayed in a display 7. 
When the user chooses one of the "smile" emoticons " . " in the display 7, the selected 
emoticon is stored as part of the short message as shown in a display 8. Then, the user 
can input a text including typical characters, special characters, or emoticons within the 
range of a transmittable SMS message, by changing input modes" (Paragraph 41), and 
"After an intended text is completed, the user instructs the mobile terminal to transmit 
the SMS message including the emoticon... the mobile terminal transmits the stored 
message" (Paragraph 42). The examiner further notes that it is common knowledge 
that when text messages are received via a device, the entire message is displayed at 
once. The examiner further notes that Hyon teaches " so that said registered image 
is sandwiched between two parts of said text of said predetermined kind of 
character In a line of said Identical sentence " as "a display 16 outputs display data 
and text messages generated in the mobile terminal. An LCD (Liquid Crystal Display) 
can be used as the display 16" (Paragraph 21), "If the user selects "smile" in the display 
6 by manipulating a left/right directional key, emoticons that belong to the group "smile" 
are displayed in a display 7. When the user chooses one of the "smile" emoticons " . " in 
the display 7, the selected emoticon is stored as part of the short message as shown in 
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a display 8. Then, the user can input a text including typical characters, special 
characters, or emoticons within the range of a transmittable SMS message, by changing 
input modes" (Paragraph 41), and "After an intended text is completed, the user 
instructs the mobile terminal to transmit the SMS message including the emoticon...the 
mobile terminal transmits the stored message" (Paragraph 42). The examiner further 
notes that display 8 in Figure 4 depicts an emoticon in between text. 

Hyon does not explicitly teach: 
C) with respect to display data containing a series of a character code, text attribute 
data, and said Image code, transforming said registered image to be displayed 
according to said text attribute data; 

F) wherein said text attribute data contains size attribute data indicating a character 
size of said text : and 

G) said image transforming means that scales up/down said registered image in 
accordance with said attribute data . 

Baker, however, teaches "with respect to display data containing a series of 
a character code, text attribute data, and said image code, transforming said 
registered image to be displayed according to said text attribute data" as "in order 
to accommodate the use of different size fonts in the mailbox display, means for scaling 
the size of the icon graphics are also provided... at least one image for each icon is 
stored, the icon most closely matching the point size of the font is chosen and then 
scaled as needed to better match the font point size" (Column 8, lines 26-40), " wherein 
said text attribute data contains size attribute data indicating a character size of 
said text " as "in order to accommodate the use of different size fonts in the mailbox 
display, means for scaling the size of the icon graphics are also provided. ..at least one 
image for each icon is stored, the icon most closely matching the point size of the font is 
chosen and then scaled as needed to better match the font point size" (Column 8, lines 
26-40), and " said image transforming means that scales up/down said registered 
image in accordance with said attribute data " as "in order to accommodate the use 
of different size fonts in the mailbox display, means for scaling the size of the icon 
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graphics are also provided... at least one image for each icon is stored, the icon most 
closely matching the point size of the font Is chosen and then scaled as needed to 
better match the font point size" (Column 8, lines 26-40). 

It would have been obvious to one of ordinary skill in the art at the time the 
invention was made to combine the teachings of the cited references because teaching 
Baker's would have allowed Hyon's to provide a method for allowing for scalable icons 
to accompany texts with specified and varied fonts in order to easily associate an icon 
to a particular sentence, as noted by Baker (Column 5, lines 40-55). 

Regarding claim 8, Hyon teaches a computer readable recording medium 
comprising: 

A) storing an Image code for specifying said registered image and registered image 
data corresponding to said image code (Paragraphs 23, 25, and 44, Figure 2); 

B) said registered image being generated by a user and stored in a storage portion 
different from a storage portion of storing the predetermined kind of character 
(Paragraphs 23 and 44); 

D) displaying said predetermined kind of character and said registered image 
simultaneously based on said transformed registered image (Paragraphs 21 and 41- 
42); 

E) so that said registered image is sandwiched between two parts of said text of said 
predetermined kind of character in a line of said identical sentence (Paragraphs 21 , 41- 
42, Figure 4). 

The examiner notes that Hyon teaches "storing an image code for specifying said 
registered image and registered image data corresponding to said image code" 

as "A storage 18 is comprised of a ROM (Read Only Memory) and a RAM (Random 
Access Memory) for storing programs and data, and a voice memory. The storage 18 
stores an operation program for inputting emoticons and a plurality of emoticons in the 
form of a bit map according to the embodiment of the present invention. The plurality of 
emoticons are stored by groups in the storage 18 to facilitate selection of emoticons" 



Application/Control Number: 

10/516,881 

Art Unit: 2168 



Page 15 



(Paragraph 23), "storage 18 stores oriental or occidental emoticons according to the 
cultural area of a user" (Paragraph 25), and "A plurality of emoticons are pre-stored in a 
mobile terminal so that a user easily select an intended emoticon in the present 
invention. In another embodiment, the user can add hieroglyphics to basic emoticons 
stored by a manufacturer. The hieroglyphics can be stored in three ways: the user 
directly stores them, receives them from a base station and the stores them, or 
downloads them from the Internet. The user can change and edit the emoticons stored 
in the mobile terminal" (Paragraph 44). The examiner further notes that Hyon teaches 
"said registered image being generated by a user and stored in a storage portion 
different from a storage portion of storing the predetermined kind of character" 
as "A storage 18 is comprised of a ROM (Read Only Memory) and a RAM (Random 
Access Memory) for storing programs and data, and a voice memory. The storage 18 
stores an operation program for inputting emoticons and a plurality of emoticons in the 
fomi of a bit map according to the embodiment of the present invention. The plurality of 
emoticons are stored by groups in the storage 18 to facilitate selection of emoticons" 
(Paragraph 23) and "In another embodiment, the user can add hieroglyphics to basic 
emoticons stored by a manufacturer. The hieroglyphics can be stored in three ways: 
the user directly stores them, receives them from a base station, and the stores them, or 
downloads them from the Internet" (Paragraph 44). The examiner further notes that it is 
clear that the emoticons which are edited, changed, and user-generated must be stored 
in the RAM of storage 18 since items stored in RAM can be written to whereas items 
stored in ROM cannot be written (i.e. are Read-Only). The examiner further notes that 
items which are clearly not edited/changed/manipulated (i.e. text characters) would be 
stored in ROM of storage 18. Moreover, the examiner further wishes to state that it is 
well known that text characters from a particular font are stored in ROM and not RAM 
(see cited reference of Hersum (see column 4, lines 55-67 for reference). The 
examiner further notes that Hyon teaches "displaying said predetermined kind of 
character and said registered image simultaneously based on said transformed 
registered image" as "a display 16 outputs display data and text messages generated 
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in the mobile terminal. An LCD (Liquid Crystal Display) can be used as the display 16" 
(Paragraph 21), "If the user selects "smile" in the display 6 by manipulating a left/right 
directional key, emoticons that belong to the group "smile" are displayed In a display 7. 
When the user chooses one of the "smile" emoticons " . " in the display 7, the selected 
emoticon is stored as part of the short message as shown in a display 8. Then, the user 
can input a text including typical characters, special characters, or emoticons within the 
range of a transmittable SMS message, by changing input modes" (Paragraph 41), and 
"After an intended text is completed, the user instructs the mobile terminal to transmit 
the SMS message including the emoticon... the mobile terminal transmits the stored 
message" (Paragraph 42). The examiner further notes that it is common knowledge 
that when text messages are received via a device, the entire message is displayed at 
once. The examiner further notes that Hyon teaches " so that said registered image 
is sandwiched between two parts of said text of said predetermined l<ind of 
character in a line of said identical sentence " as "a display 16 outputs display data 
and text messages generated in the mobile terminal. An LCD (Liquid Crystal Display) 
can be used as the display 16" (Paragraph 21), "If the user selects "smile" in the display 
6 by manipulating a left/right directional key, emoticons that belong to the group "smile" 
are displayed in a display 7. When the user chooses one of the "smile" emoticons " . " in 
the display 7, the selected emoticon is stored as part of the short message as shown in 
a display 8. Then, the user can input a text including typical characters, special 
characters, or emoticons within the range of a transmittable SMS message, by changing 
input modes" (Paragraph 41), and "After an intended text is completed, the user 
instructs the mobile terminal to transmit the SMS message including the emoticon... the 
mobile terminal transmits the stored message" (Paragraph 42). The examiner further 
notes that display 8 in Figure 4 depicts an emoticon in between text. 

Hyon does not explicitly teach: 
C) with respect to display data containing a series of a character code, text aftribute 
data, and said image code, transforming said registered image to be displayed 
according to said text aftribute data; 
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F) wherein said text attribute data contains size attribute data indicating a character 
size of said text : and 

G) said image transforming means that scales uo/down said registe red image in 
accordance with said attribute data . 

Baker, however, teaches "with respect to display data containing a series of 
a character code, text attribute data, and said image code, transforming said 
registered image to be displayed according to said text attribute data" as "in order 
to accommodate the use of different size fonts in the mailbox display, means for scaling 
the size of the icon graphics are also provided. ..at least one image for each icon is 
stored, the icon most closely matching the point size of the font is chosen and then 
scaled as needed to better match the font point size" (Column 8, lines 26-40), " wherein 
said text attribute data contains size attribute data indicating a character size of 
said texf as "in order to accommodate the use of different size fonts in the mailbox 
display, means for scaling the size of the icon graphics are also provided... at least one 
image for each icon is stored, the icon most closely matching the point size of the font is 
chosen and then scaled as needed to better match the font point size" (Column 8, lines 
26-40), and " said image transforming means that scales up/down said registered 
image in accordance with said attribute data " as "In order to accommodate the use 
of different size fonts in the mailbox display, means for scaling the size of the icon 
graphics are also provided. ..at least one image for each icon is stored, the icon most 
closely matching the point size of the font is chosen and then scaled as needed to 
better match the font point size" (Column 8, lines 26-40). 

It would have been obvious to one of ordinary skill in the art at the time the 
invention was made to combine the teachings of the cited references because teaching 
Baiter's would have allowed Hyon's to provide a method for allowing for scalable icons 
to accompany texts with specified and varied fonts in order to easily associate an icon 
to a particular sentence, as noted by Bal<er (Column 5, lines 40-55). 

Regarding claim 13, Hyon further teaches a display device comprising: 
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A) wherein the first storage portion is a ROM (Paragraph 23); and 

B) the second storage portion is a RAM (Paragraphs 23 and 44). 

The examiner notes that Hyon teaches "wherein the first storage portion is a 
ROM" as "A storage 18 is comprised of a ROM (Read Only Memory) and a RAM 
(Random Access Memory) for storing programs and data, and a voice memory. The 
storage 18 stores an operation program for inputting emoticons and a plurality of 
emoticons in the form of a bit map according to the embodiment of the present 
invention. The plurality of emoticons are stored by groups in the storage 18 to facilitate 
selection of emoticons" (Paragraph 23). The examiner further notes that items which 
are clearly not edited/changed/manipulated (i.e. text characters) would be stored in 
ROM of storage 18. Moreover, the examiner further wishes to state that it is well known 
that text characters from a particular font are stored in ROM and not RAM (see cited 
reference of Hersum (see column 4, lines 55-67 for reference). The examiner further 
notes that Hyon teaches "the second storage portion is a RAM" as "A storage 18 is 
comprised of a ROM (Read Only Memory) and a RAM (Random Access Memory) for 
storing programs and data, and a voice memory. The storage 18 stores an operation 
program for inputting emoticons and a plurality of emoticons in the form of a bit map 
according to the embodiment of the present invention. The plurality of emoticons are 
stored by groups in the storage 18 to facilitate selection of emoticons" (Paragraph 23) 
and "A plurality of emoticons are pre-stored in a mobile terminal so that a user easily 
select an intended emoticon in the present invention. In another embodiment, the user 
can add hieroglyphics to basic emoticons stored by a manufacturer. The hieroglyphics 
can be stored in three ways: the user directly stores them, receives them from a base 
station and the stores them, or downloads them from the Internet. The user can change 
and edit the emoticons stored in the mobile tenninal" (Paragraph 44). The examiner 
further notes that it is clear that the emoticons which are edited, changed, and user- 
generated must be stored in the RAM of storage 18 since items stored in RAM can be 
written to whereas items stored in ROM cannot be written (i.e. are Read-Only). 
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9. Claims 3-5, 9-12, 14-16, and 18 are rejected under 35 U.S.C. 103(a) as being 
unpatentable over Hyon (U.S. PGPUB 2002/00771 35) and in view of Baker (U.S. 
Patent 6,546,417) as applied to claims 1-2, 6-8, and 13 and further in view of 
Ostermann et al. (U.S. Patent 6,990,452). 

10. Regarding claim 3, Hyon and Baker do not explicitly teach a display device 
comprising: 

A) wherein said text attribute data contains color attribute data indicating at least a fore 
color of a corresponding predetermined kind of character; and 

B) said image transforming means converts a color of said registered image according 
to said color attribute data. 

Ostermann, however, teaches "wherein said text attribute data contains 
color attribute data indicating at least a fore color of a corresponding 
predetermined kind of character" as "The sender can associate typed words with an 
emoticon by underlining, coloring, highlighting, or by any other means. For example, 
the method may comprise providing the sender an option to assign a color to the at 
least typed one word such that the chosen emoticon begins to be presented by the 
animated entity to the recipient at the first typed word with the assigned color and the 
chosen emoticon presentation by the animated entity ends at the last typed word with 
the assigned color" (Column 11, lines 43-50) and "said image transforming means 
converts a color of said registered image according to said color attribute data" 
as "The sender can associate typed words with an emoticon by underlining, coloring, 
highlighting, or by any other means. For example, the method may comprise providing 
the sender an option to assign a color to the at least typed one word such that the 
chosen emoticon begins to be presented by the animated entity to the recipient at the 
first typed word with the assigned color and the chosen emoticon presentation by the 
animated entity ends at the last typed word with the assigned color" (Column 11, lines 
43-50). 

It would have been obvious to one of ordinary skill in the art at the time the 
invention was made to combine the teachings of the cited references because teaching 
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Ostermann's would have allowed Hyon's and Baker's to provide a method to allow 
the ability to insert a customized emoticon or specified image by a single button click, as 
noted by Ostermann (Column 3, lines 35-54). 

Regarding claim 4, Hyon and Baker do not explicitly teach a display device 
comprising: 

A) wherein when said registered is a gray image, said Image transforming means 
converts each pixel of said registered image into a color made by mixing the fore color 
and a back color of said text at a ratio according to a pixel value of said predetermined 
kind of character. 

Ostermann, however, teaches "wherein when said registered is a gray 
image, said image transforming means converts each pixel of said registered 
image into a color made by mixing the fore color and a back color of said text at a 
ratio according to a pixel value of said predetermined kind of character" as "The 
increased intensity of the emoticon may be accomplished by changing the icon from 
black-on-white background to black-on-colored background (such as red or yellow) 
where the intensity of the background color reflects the amplitude" (Column 9, lines 43- 
67) and "The sender can associate typed words with an emoticon by underlining, 
coloring, highlighting, or by any other means. For example, the method may comprise 
providing the sender an option to assign a color to the at least typed one word such that 
the chosen emoticon begins to be presented by the animated entity to the recipient at 
the first typed word with the assigned color and the chosen emoticon presentation by 
the animated entity ends at the last typed word with the assigned color" (Column 1 1 , 
lines 43-50) 

It would have been obvious to one of ordinary skill in the art at the time the 
invention was made to combine the teachings of the cited references because teaching 
Ostermann's would have allowed Hyon's and Baker's to provide a method to allow 
the ability to insert a customized emoticon or specified image by a single button click, as 
noted by Ostermann (Column 3, lines 35-54). 
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Regarding claim 5, Hyon and Baker do not explicitly teach a display device 
comprising: 

A) wherein said text attribute data contains decoration attribute data indicating a type of 
a decoration applied to a corresponding predetermined kind of character; and 

B) said image transforming means decorates said registered image according to said 
decoration attribute data. 

Ostermann, however, teaches "wherein said text attribute data contains 
decoration attribute data indicating a type of a decoration applied to a 
corresponding predetermined l<ind of character" as "The sender can associate 
typed words with an emoticon by underlining, coloring, highlighting, or by any other 
means... In this case, in a sentence such as "Hi John, :-) are you pleased that the stock 
market is up?" the underlining represents the highlighting wherein the sender chooses 
to begin the smile at the beginning of the word "are" and to continue the smile through 
the word "up". The method comprises receiving the indicated duration of the emoticon 
and presenting the chosen duration of the emoticon" (Column 11, lines 43-61) and 
"said image transforming means decorates said registered image according to 
said decoration attribute data" as "The sender can associate typed words with an 
emoticon by underlining, coloring, highlighting, or by any other means... In this case, in a 
sentence such as "Hi John, :-) are you pleased that the stock marlcet is up?" the 
underlining represents the highlighting wherein the sender chooses to begin the smile at 
the beginning of the word "are" and to continue the smile through the word "up". The 
method comprises receiving the indicated duration of the emoticon and presenting the 
chosen duration of the emoticon" (Column 11, lines 43-61). 
It would have been obvious to one of ordinary skill in the art at the time the invention 
was made to combine the teachings of the cited references because teaching 
Ostermann's would have allowed Hyon's and Baker's to provide a method to allow 
the ability to insert a customized emoticon or specified image by a single button click, as 
noted by Ostermann (Column 3, lines 35-54). 
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Regarding claim 9, Hyon and Baker do not explicitly teach a display device 
comprising: 

A) wherein said transforming means includes image decoration means for decorating 
said registered image to provide continuous decoration to both said reoistered image 
and neighboring predetermined kind of characters adjacent to said registered image 
according to said decoration attribute data. 

Ostermann, however, teaches "wherein said transforming means includes 
image decoration means for decorating said registered image to provide 
continuous decoration to both said registered image and neighboring 
predetermined kind of characters adjacent to said registered image according to 
said decoration attribute data" as "The sender can associate typed words with an 
emoticon by underlining, coloring, highlighting, or by any other means... In this case, in a 
sentence such as "Hi John, :-) are you pleased that the stock market is up?" the 
underlining represents the highlighting wherein the sender chooses to begin the smile at 
the beginning of the word "are" and to continue the smile through the word "up". The 
method comprises receiving the indicated duration of the emoticon and presenting the 
chosen duration of the emoticon as the animated entity delivers the message. As 
mentioned above, the highlighting can occur through coloring words, underlining words, 
or some other means of presenting the emotion" (Column 11, lines 43-61). 

It would have been obvious to one of ordinary skill in the art at the time the 
invention was made to combine the teachings of the cited references because teaching 
Ostermann's would have allowed Hyon's and Baker's to provide a method to allow 
the ability to insert a customized emoticon or specified image by a single button click, as 
noted by Ostermann (Column 3, lines 35-54). 

Regarding claim 10, Hyon and Baker do not explicitly teach a display device 
comprising: 
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A) wherein said image decoration means decorates said registered image, such that 
both said registered image and said neighboring predetermined kind of characters show 
the said fore and back colors continuously. 

Ostermann, however, teaches "wherein said image decoration means 
decorates said registered image, sucli that both said registered image and said 
neighboring predetermined l<ind of characters show the said fore and bacl( colors 
continuously" as The increased intensity of the emoticon may be accomplished by 
changing the icon from black-on-white background to black-on-colored background 
(such as red or yellow) where the intensity of the background color reflects the 
amplitude" (Column 9, lines 43-67) and "The sender can associate typed words with an 
emoticon by underlining, coloring, highlighting, or by any other means... In this case, in a 
sentence such as "Hi John, :-) are you pleased that the stock market is up?" the 
underlining represents the highlighting wherein the sender chooses to begin the smile at 
the beginning of the word "are" and to continue the smile through the word "up". The 
method comprises receiving the indicated duration of the emoticon and presenting the 
chosen duration of the emoticon as the animated entity delivers the message. As 
mentioned above, the highlighting can occur through coloring words, underlining words, 
or some other means of presenting the emotion" (Column 1 1 , lines 43-61). 

It would have been obvious to one of ordinary skill in the art at the time the 
invention was made to combine the teachings of the cited references because teaching 
Ostermann's would have allowed Hyon's and Baker's to provide a method to allow 
the ability to insert a customized emoticon or specified image by a single button click, as 
noted by Ostermann (Column 3, lines 35-54). 

Regarding claim 11, Hyon and Baker do not explicitly teach a display device 
comprising: 

A) wherein said image decoration means decorates said registered image to draw a 
continuous underline below both said registered image and said neighboring 
predetermined kind of characters. 
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Ostermann, however, teaches "wherein said image decoration means 
decorates said registered image to draw a continuous underline below both said 
registered image and said neighboring predetermined kind of characters" as "The 
sender can associate typed words with an emoticon by underlining, coloring, 
highlighting, or by any other means... In this case, in a sentence such as "Hi John, :-) 
are you pleased that the stock market is up?" the underlining represents the highlighting 
wherein the sender chooses to begin the smile at the beginning of the word "are" and to 
continue the smile through the word "up". The method comprises receiving the 
indicated duration of the emoticon and presenting the chosen duration of the emoticon 
as the animated entity delivers the message. As mentioned above, the highlighting can 
occur through coloring words, underlining words, or some other means of presenting the 
emotion" (Column 1 1 , lines 43-61 ). 

It would have been obvious to one of ordinary skill in the art at the time the 
invention was made to combine the teachings of the cited references because teaching 
Ostermann's would have allowed Hyon's and Baker's to provide a method to allow 
the ability to insert a customized emoticon or specified image by a single button click, as 
noted by Ostermann (Column 3. lines 35-54). 

Regarding claim 12, Hyon and Baker do not explicitly teach a display device 
comprising: 

A) wherein said image decoration means decorates said registered image to draw a 
continuous cancel line on both said registered image and said neighboring 
predetermined kind of characters. 

Ostermann, however, teaches "wherein said image decoration means 
decorates said registered image to draw a continuous cancel line on both said 
registered image and said neighboring predetermined kind of characters" as "The 
sender can associate typed words with an emoticon by underlining, coloring, 
highlighting, or by any other means... In this case, in a sentence such as "Hi John, :-) 
are you pleased that the stock market is up?" the underlining represents the highlighting 
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wherein the sender chooses to begin the smile at the beginning of the word "are" and to 
continue the smile through the word "up". The method comprises receiving the 
indicated duration of the emoticon and presenting the chosen duration of the emoticon 
as the animated entity delivers the message. As mentioned above, the highlighting can 
occur through coloring words, underlining words, or some other means of presenting the 
emotion" (Column 1 1 , lines 43-61 ). 

The examiner notes that it is clear that Ostermann's method can use various 
computer font techniques to apply to sentences with emoticons, such as underlines and 
highlighters. 

It would have been obvious to one of ordinary skill in the art at the time the 
invention was made to combine the teachings of the cited references because teaching 
Ostermann's would have allowed Hyon's and Baker's to provide a method to allow 
the ability to Insert a customized emoticon or specified image by a single button click, as 
noted by Ostermann (Column 3, lines 35-54). 

Regarding claims 14-16, and 18, Hyon and Baker do not explicitly teach a 
display device, display method, viewer program, and computer-readable recording 
medium comprising: 

A) wherein the text containing the predetemiined kind of character and the registered 
image is used in a Hyper Text Markup Language document. 

Ostermann, however, teaches "wherein the text containing the 
predetermined kind of character and the registered image is used in a l-lyper Text 
(Markup Language document" as "FIG. 4(a) illustrates a high-bandwidth architecture 
60 associated with the embodiments of the invention. The system 60 delivers a hyper- 
text mark-up language (HTML) page through the Internet 62 (connected to a web 
server, not shown but embodied in the Internet 62) to a client application 64. The HTML 
page (shown by way of example in FIG. 6) enables the sender to create a multi-media 
message. The client application may be, for example, a web browser such as 
Microsoft's Internet Explorer. RTM.. Other client applications include e-mail and instant 
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messaging clients. The sender creates the multi-media message using the HTML page" 
(Column 4, lines 53-63). 

The examiner notes that it Is clear that Ostermann's method can use various 
computer font techniques to apply to sentences with emoticons, such as underlines and 
highlighters. 

It would have been obvious to one of ordinary skill in the art at the time the 
invention was made to combine the teachings of the cited references because teaching 
Ostermann's would have allowed Hyon's and Baker's to provide a method to allow 
the ability to insert a customized emoticon or specified image by a single button click, as 
noted by Ostermann (Column 3, lines 35-54). 

Response to Arguments 
1 1 . Applicant's arguments filed on 12/276/2007 have been fully considered but they 
are not persuasive. 

Applicant argues on page 1 1 , that "Hyon such that the size of 
emoticons... fails to disclose or suggest "a display control portion... identical 
sentence". However, the examiner wishes to point to paragraphs 21 , and 41-42 of 
Hyon which state "a display 16 outputs display data and text messages generated In 
the mobile terminal. An LCD (Liquid Crystal Display) can be used as the display 16" 
(Paragraph 21), "If the user selects "smile" in the display 6 by manipulating a left/right 
directional key, emoticons that belong to the group "smile" are displayed in a display 7. 
When the user chooses one of the "smile" emoticons " . " in the display 7, the selected 
emoticon is stored as part of the short message as shown In a display 8. Then, the user 
can input a text including typical characters, special characters, or emoticons within the 
range of a transmittable SMS message, by changing input modes" (Paragraph 41), and 
"After an intended text is completed, the user instructs the mobile temriinal to transmit 
the SMS message Including the emoticon... the mobile terminal transmits the stored 
message" (Paragraph 42). The examiner further notes that display 8 in Figure 4 depicts 
an emoticon in between text of a single sentence. 

Conclusion 
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12. The prior art made of record and not relied upon is considered pertinent to 
applicant's disclosure. 

U.S. Patent 6,987,991 by Nelson on 17 January 2006. The subject matter 
disclosed therein is pertinent to that of claims 1-16, and 18 (e.g., methods automatically 
scale graphics into a text sentence that is sent to another user). 

U.S. PGPUB 2002/0120653 by Kraft et al. on 29 August 2002. The subject 
matter disclosed therein is pertinent to that of claims 1-16, and 18 (e.g., methods 
automatically scale graphics into a text sentence that is sent to another user). 

U.S. Patent 6,584,479 by Chang et al. on 24 June 2003. The subject matter 
disclosed therein is pertinent to that of claims 1-16, and 18 (e.g., methods automatically 
scale graphics into a text sentence that is sent to another user). 

U.S. Patent 6,456,305 by Qureshi et al. on 24 September 2002. The subject 
matter disclosed therein is pertinent to that of claims 1-16, and 18 (e.g., methods 
automatically scale graphics into a text sentence that is sent to another user). 

U.S. Patent 5,301,106 by Hersum on 05 April 1994. The subject matter 
disclosed therein is pertinent to that of claims 1-16, and 18 (e.g., methods automatically 
scale graphics into a text sentence that is sent to another user). 

1 3. Applicant's amendment necessitated the new ground(s) of rejection presented in 
this Office action. Accordingly, THIS ACTION IS MADE FINAL. See MPEP 

§ 706.07(a). Applicant is reminded of the extension of time policy as set forth in 37 
CFR 1.136(a). 

A shortened statutory period for reply to this final action is set to expire THREE 
MONTHS from the mailing date of this action. In the event a first reply is filed within 
TWO MONTHS of the mailing date of this final action and the advisory action is not 
mailed until after the end of the THREE-MONTH shortened statutory period, then the 
shortened statutory period will expire on the date the advisory action is mailed, and any 
extension fee pursuant to 37 CFR 1.136(a) will be calculated from the mailing date of 
the advisory action. In no event, however, will the statutory period for reply expire later 
than SIX MONTHS from the date of this final action. 
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Contact Information 



14. Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Mahesh Dwivedi whose telephone number is (571) 272- 
2731. The examiner can normally be reached on Monday to Friday 8:20 am - 4:40 pm. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Tim Vo can be reached (571) 272-3642. The fax number for the 
organization where this application or proceeding is assigned is (571) 273-8300. 

Information regarding the status of an application may be obtained from the 
Patent Application Information Retrieval (PAIR) system. Status information for 
published applications may be obtained from either Private PAIR or Public PAIR. 
Status Information for unpublished applications Is available through Private PAIR only. 
For more information about the PAIR system, see http://pair-direct.uspto.gov . Should 
you have questions on access to the Private PAIR system, contact the Electronic 
Business Center (EBC) at 866-21 7-91 97 (toll-free). 
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